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Abstract. We consider the detection of correlated information sources in the 
ubiquitous Code-Division Multiple- Access (CDMA) scheme. We propose a message- 
passing based scheme for detecting correlated sources directly, with no need for 
source coding. The detection is done simultaneously over a block of transmitted 
binary symbols (word). Simulation results are provided demonstrating a substantial 
improvement in bit-error-rate in comparison with the unmodified detector and 
the alternative of source compression. The robustness of the error-performance 
improvement is shown under practical model settings, including wrong estimation of 
the generating Markov transition matrix and hnite-length spreading codes. 
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1. Introduction 

Code division multiple access (CDMA) is a core technology of today's wireless 
communication employing data transmission between multiple terminals and a single 
base station. Usually in the uncoded CDMA literature pQ, the binary information 
source, modulated for transmission over the channel is assumed to be taken from an 
unbiased identically independently distributed (i.i.d.) random process. 

In practice, however, a substantial level of redundancy can often be observed in 
real-life uncoded sources (e.g., uncompressed binary images) which can be viewed as 
a (global) bias in the generating Bernoulli distribution or as correlations between the 
binary symbols. These correlations can be considered as a local bias on a certain symbol 
in the generating Bernoulli distribution. In such binary source encoding is 

used. A source encoder is said to be optimal if it can eliminate all source redundancies 
and eventually generate unbiased outputs. However, most existing practical source 
encoders, which are typically fixed-length encoders, are sub-optimal. Besides the 
extensive complexity of the encoder, its output still contains a certain level of bias 
or correlations, which can be further exploited in the transceiver design. 

As for coded systems, it has been shown [2] that the empirical distribution of 
any 'good' error-correcting code converges to the channel's capacity-achieving input 
distribution. A 'good' code is a code approaching capacity with asymptotically vanishing 
probability of error. Hence, well-coded information sources, in the common case 
of binary-input additive white Gaussian noise (BI-AWGN) CDMA channel, must be 
unbiased, as the capacity-achieving input distribution of the BI-AWGN channel is 
Bernoulli 1/2 j3]. However, bias (global and local) can be found in practical coded 
CDMA systems in which not so 'good' codes are being employed, e.g. , systematic Turbo 
codes [1H6], for which the systematic component of the code entails bias. 

A different approach than source compression for handling CDMA with biased 
sources was lately introduced [7]- In the presented scheme the source bias m was 
assumed to be estimated by the receiver and used for modifying both the naive single- 
user matched- filter (SUMF) and state-of-the-art CDMA multiuser detectors (MUD). 
That modification outperformed the alternative of applying source coding by detecting 
modulated biased sources directly, with no need of source encoding. 

A substantial level of redundancy can also be viewed as correlations between the 
binary symbols with no (global) bias. In this case the aforementioned scheme is useless. 
Still the correlations, which contain local bias, can be used for an improved detection. 

Therefore, tuning CDMA detection for correlated sources is of major importance 
in both coded and uncoded settings. In this paper, we examine the commonly-used 
random spreading scheme, which lends itself to analysis and well describes CDMA with 
long signature sequences. We suggest a scheme for handling CDMA with correlated 
sources, rather than using source compression. 

We propose a scheme in which the source correlations are assumed to be estimated 
by the receiver, or reported periodically to the receiver via an auxiliary low-rate channel. 
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The source correlations are used for evaluating the applied local bias, m, on each 
transmitted binary symbol, followed by adding a correction factor of the form tanh -1 m 
to the multiuser CDMA detector [7], recently introduced by Kabashima [8]. The 
proposed scheme outperforms the alternative of applying source coding throughout a 
wide range of practical correlation values. Also the derived scheme is shown to yield 
an improved error performance not only for a large system limit (the limit where the 
number of users and spreading codes tend to infinity but with a fixed ratio, which is 
defined as the system load (3), but also for finite-length spreading codes. Note that the 
proposed scheme is not optimal, yet heuristically presents a good error performance and 
convergence rate. The BER performance may be affected due to the finite size effect 
of the transmitted word of each user, where the correlation length is comparable. Also 
it may be influenced in case where the applied local bias leads to a non-optimal fixed 
point of Kabashima's algorithm. 

2. CDMA with correlated information sources 

Consider a i^-user synchronous direct-sequence binary phase shift-keying (DS/BPSK) 
CDMA system employing random binary spreading codes of N chips over additive white 
Gaussian noise (AWGN) channel. The received signal of such a system can be expressed 
as 



where s^k = ±1 (/^ = 1> • • • j N, k = 1, . . . , K) are the binary spreading chips being 
independently and equiprobably chosen. The deterministic chip waveform is assumed 
to be of unit energy; is an AWGN sample taken from the Gaussian distribution 
A/"(0,cr 2 ); bk is the (possibly coded) information source binary symbol transmitted by 
the /c'th user and is modeled by a Markov process, generated by a Markov transition 
matrix. In this paper we demonstrate our scheme for information source binary symbols 
which are modeled by a 2-state (2S) Markov process, generated by the following Markov 
transition matrix 



where (a, b = ±1) is the probability of transmitting a binary symbol b following the 
transmission of a binary symbol a. We assume that each user sends a word, each is 
assembled from L symbols. 

We work under two scenarios regarding the Markov transition matrix. In the first 
scenario the matrix is assumed to be known to the receiver as side information, for 
example, after reported via an auxiliary low-rate feedback channel from the receiver. 
The second scenario refers to the case where there is no side information channel. In 
this case the estimation of the Markov parameters iT a b) can be done in each iteration 
of the decoding process according to the tentative value of the decoded words of all 




k=l 



(1) 




(2) 
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the users. According to the probabilities of each decoded binary symbol to be ±1, the 
probabilities of decoding a binary symbol b after a (i.e, T ab ) can easily be evaluated. 

We assume a prefect power-control mechanism yielding unit energy transmissions. 
Also we assume a situation where N and K are large, yet the system load factor 
P = K/N is kept finite. 

The goal of the MUD is to simultaneously detect binary symbols b±, b 2 , bx after 
receiving the signals yi,y2, ■■■,Un- The Bayesian approach offers a useful framework for 
this. Assuming that the binary signals are independently generated from the unbiased 
distribution, the posterior distribution from the received signals is provided as 

- "^ P( !f> (3) 
Eb n M =i^(^i b ) 



where 



P (^l b ) = k — n ex P 



V2 



TXO 



2 



2a 2 



(4) 



and A » = 7n Ef=i s »kb k . 

Recently, Kabashima [8] has introduced a tractable iterative CDMA MUD which is 

based on the celebrated belief propagation algorithm (BP, [9|fT0]). This novel algorithm 
exhibits considerably faster convergence than conventional multistage detection [TTj 
without increasing computational cost significantly. It is considered to provide a nearly- 
optimal detection when the spreading factor N is large and the noise level is known. 
Similarly to multistage detection, at each iteration cycle t this detector computes 
tentative soft decisions rf k for each user transmission, of the form 

^ = tanh(/4). (5) 

The parameters rf k and h\ are coupled and being iteratively computed using the 
following recipe 

K 

U{ =A t Y,W kl 4 + A t p(l-Q t )U{-\ (6) 
i=i 

h\ +1 = RX -U{ + A%{\ - Q')£/J-\ (7) 
R* = A 1 + A*/3(l - Q^R*- 1 , (8) 

where W kl 4 s^/N, Q l ± Ek=M) 2 /K, A* 4 ^+p(i-Qt))-i and tentative 

hard-decisions are taken by b k = sign(^|.). Producing b k = b l k +1 ,Wk, serves as the 
convergence criterion. 



3. Improving detection for correlated sources 

In order to exploit all the possible knowledge for the detection of each symbol, let all 
the words of all the users (b l k ,b l k +1 ,...,b l k+1 ,b l k \\..., where k = 1..K and I = 1..L) be 
transmitted altogether to the receiver (total amount of L x K binary symbols). As a 
result, in the decoding process, the decoder has a maximum knowledge of the correlations 
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of b l k (in our case with b l k l and b l k l ). As described in ([T]) the transmitted binary symbols 
are modulated over AWGN channel. In this case, of transmitting all the words of all 
the users, we reformulate ([1]) to have the new form of the received signal 

1 - 

VA fc= i 

With the received signals, the decoder applies a SUMF according to 
1 - 

^ = 7^E^m- (io) 

Using the output of the SUMF, h l k , the decoder evaluates the probabilities of each 
symbol to be b\ = 1 or b\ = — 1 according to 

m = 1} = i±u^m 

and 

U» t = _ 1) = i-*^W . (12) 

Following eq. ( TTTl) and ( fl2l) and using the Markov transition matrix, T a &, the 
detector evaluates the applied local bias on each bit using the following recipe: 

p l M = i) = E ^( a ) • T «i • • T ^> ( 13 ) 

o,6=±l 



a,b=±l 



and 



m ' = 2 P ^ ~ ^ i (15) 

A{k = i)+p l M = -i) 

We can now incorporate a correction factor for error-performance improvement, 
based on the local bias (JT5|) . to the SUMF output f llOp and finally have a binary decision 

6 fe = sign(4 + 4), (16) 

where sign(-) is the hard-decision signum function and = (ft + a 2 ) tanh" 1 m l k [7J. 

We can also employ the tractable iterative CDMA MUD ([ME])- In order to adapt 
the MUD for correlated sources and to the case of detecting all the words of all the users 
simultaneously, we reformulate (jSJ) to have the new form 

74 = tanh(/4 + £L), (17) 

where £ l kt = tanh -1 m l kt is a correction factor for error-performance improvement being 
incorporated within the detection algorithm [7J. 

After each iteration of the MUD, an evaluation of the probabilities of each symbol 
to be P k = 1 or b l k = — 1 is assessed according to flllfl2p . followed by a calculation of the 
local bias which is applied on each symbol ( JT3|14|ll5p and finally by another iteration of 
the MUD with the correction factor ( TTTl) . 
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Figure 1. (a) Bit error rate (BER) vs. the relative location of a bit in a word for 
= 1000, (3 = 0.8, a — 0.8, Markov transition matrix with eigenvalues Ai = 1 and 
A 2 = 0.8 and for several length of words L = 10, 20, 30, 40, 60, 80, 100, 120. Simulation 
results are averaged over 2000 samples, (b) The relative position in the detected word 
where the BER is 20% above the minimum BER vs. the length of the detected word, L, 
for N — 1000, /3 — 0.8, a = 0.8 and for several Markov transition matrices. Simulation 
results are averaged over 2000 samples, (c) SUMF BER vs. the relative location of a bit 
in a word for N = 1000, (3 = 0.8, a = 0.8, Markov transition matrix with eigenvalues 
Ai = 1 and A 2 = 0.8 and for several length of words L = 10,20,30,40,60,80. 
Simulation results are averaged over 2000 samples. 



4. Results and discussions 

In this section, simulation results of the proposed scheme for correlated sources are 
presented. Unless stated otherwise, all the results are obtained for load (3 = 0.8 and 
a = 0.8 while simulation results are averaged over sufficiently large ensemble of 2000 
computer-simulated randomly spread AWGN CDMA samples with long spreading factor 
N = 1000. 

Figure [H-(a) displays the bit error rate (BER) of the proposed scheme fllltil5l [T71) 
as a function of the relative location of a certain binary symbol in the detected word. 
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The relative location of a certain bit is its location compared to the beginning of the 
detected word, divided by the length of the detected word. For example, in the case 
where the length of the detected word is L = 30, the relative location of the 3rd bit is 
0.1. The results were obtained for a Markov transition matrix with eigenvalues Ai = 1 
and A 2 = 0.8 and for several lengthes of words L = 10, 20, 30, 40, 60, 80, 100, 120. Results 
indicate that the portion of the word that has a substantial and stable improvement 
of the BER increases with the size of the word. This tendency can be explained by 
using the correlation length of the Markov process, £ = — xr. The effect of a wrong 

detected bit over other bits in the word vanishes for a length grater than £. For example, 
the correlation length of the aforementioned generating Markov transition matrix is 
£ = 4.48. Thus, for a detected word with length of L = 120 more than 95% of the bits 
are with (considerably) low and stable BER, while on the other hand for a detected 
word with length of L = 10, we can hardly see a saturation of the BER. Similar results 
were also obtained for small (N = 25) CDMA systems and for other Markov transition 
matrices. 

An interesting feature of the results in Figured]- (a) is the convergence to saturation 
of the BER as a function of the length of the detected word. Figure HJ- (a) shows that 
the convergence to the asymptotic BER decreases with the size of the word. 

We measured the behavior of the convergence to saturation of the BER as a function 
of the length of the word, L. Figure [T]-(b) displays the behavior of the convergence 
to saturation for correlated sources, generated by several Markov transition matrices. 
We calculated the convergence to saturation as the relative position in the detected 
word where the BER (which is displayed in Figure [U- (a)) is 20% above the level of the 
minimum BER. 

Figure [I]- (b) indicates that for all correlated sources, generated by different Markov 
transition matrices, the convergence to saturation of the BER behaves like L' 1 . Similar 
results were obtained for CDMA systems with small spreading, N = 25, and with other 
Markov transition matrices. 

Figure [H-(c) displays the BER of the proposed scheme while using (only) the popular 
and naive SUMF ( fHlfToT) as a function of the relative location of a certain binary symbol 
in the detected word. The same behavior as demonstrated in Figure [!]• (a), (b) is also 
presented here. 

Figure [2] displays the normalized BER of the proposed scheme (11111151 H7|) as a 
function of the eigenvalues of the Markov transition matrices (Ai = 1 and A 2 ) for 
L = 100. The BER is normalized by P^ ab , the estimated BER if no local bias 
modification is applied in (fT7|) (i.e., the ordinary MUD of Kabashima is used (jSJ)). 
A substantial improvement in the BER performance due to the proposed scheme is 
presented. Notice that for very high eigenvalues (Ai = 1, A2 > 0.995) the normalized 
BER grows since for these eigenvalues £ > L (e.g., £(A 2 = 0.995) 200 > L = 100 ), 
which leads to strong effects of wrong detected bits over the detected word. Figure [2] 
also presents the normalized BER under realistic model of a mismatch in the generating 
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Figure 2. Normalized BER, P£ orr /P b Kab , as a function of the eigenvalues of the 
Markov transition matrices (Ai = 1 and A2) for N = 1000, f3 — 0.8, a — 0.8 and 
L = 100, averaged over 2000 samples. Also drawn are the results of the BER under a 
mismatch of ±10% of element T_i_i. Normalized BER as a function of the correlation 
length £ is drawn in the inset. 



Markov transition matrix estimation. Considering a symmetric Markov transition 
matrix, a mismatch of ±10% of element T_i_i is examined. That is to say, the detector 
assumes that the probability to detect b l k = — 1, b 1 ^ 1 = —1 is higher/lower than the true 
probability. Clearly, the proposed scheme still suggests a substantial improvement in 
the BER for these practical settings. The sudden growing of the BER for the positive 
mismatch when A2 > 0.8 is due to the detrimental effect of infinite correlation length. 

As stated in the introduction, the mainstream alternative to our approach is source 
coding, or compression [12]. In order to evaluate the attractiveness of the proposed 
scheme, we compare its bit error probability, Pp orT , to the bit error probability, pp ouv P ) 
achieved by the nearly optimal Kabashima's multiuser detection of the transmission 
of unbiased (optimally) compressed source bits. We consider the theoretical optimal 
compression bound without limiting ourselves to any concrete algorithm. The ratio 
between these two probabilities is given by 

Pp OTT _ P fc Corr (T Cor V,/3) 
p Comp " p Comp (T i.i. d ^Comp = m) 

= H b .pP^(T^,a,P) 
Pp orr {T iA ^,a,(3 Comi P = PH b y 

where H b = — ^ a b=±l fi a Tp OTT log 2 (Tp OTT ) denotes the binary source's entropy, fi a 

denotes the stationary distribution of the correlated source and T Corr and T lld 
denote the Markov transition matrix and identically and independently distributed 
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Figure 3. A comparison of the BER obtained in simulations, using the proposed 
scheme, Pf orr , versus optimal and non-optimal (i.e., 5% above the entropy) 
compression, 

pComp The ratio p^__ . g plotted 

as a function of the 2 nd eigenvalue 
of the Markov transition matrix, X 2 , for load j3 — 0.8, a = 0.8 and L = 30. The 
comparison of the BER as a function of the correlation length £ is drawn in the inset. 



(i.i.d) matrix respectively. Note that as compression results in Hb times less compressed 
bits, they can be transmitted using an Hb times lower the bandwidth per bit. In order 
to exploit the entire bandwidth, the spreading codes should be expanded. We have 
assumed that the compressed bits are conveyed under an effectively Hb times lower load 
0. Also, in computing pp om P w ^ en we assume an optimal source code, asymptotically 
speaking, a single error in detecting a compressed bit leads, on average, to errors 
in the uncompressed information. 

Figure [3] presents simulation results of the BER ratio (ITS]) as a function of the 
eigenvalues of the Markov transition matrices (Ai = 1,A 2 ). Interestingly, applying the 
proposed scheme is superior to the optimal compression alternative for all A 2 of the 
Markov transition matrices. 

Figure |3] also demonstrates the increasing superiority of the proposed scheme over 
non-optimal compression. A sub-optimal fixed-length source encoder compressing at 5% 
above entropy is assumed. Again, this curve is obtained using ([18]) . where the optimal 
compression rate Hb is now replaced by the sub-optimal rate (1 + 0.05)Hb- 

pCorr 

Note that the same trend of the ratio p com P is also valid for /3 > 1 (for example, 
= 1.5). 

Another possible way to compare the proposed scheme and the alternative of source 
coding, is to keep the parameters (3 and a constant in both approaches. While the BER 
of the proposed scheme is calculated as explained above, the BER performance of the 
source coding is calculated as following. Applying an optimal encoder/decoder scheme, 
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we can encode a correlated sequence into the same size as for the uncompressed case 
using the rate Rate = H^. After using the the MUD algorithm of of Kabashima for 
i.i.d. sequence we end up with bit error rate, P^ ab , which is now the starting point 
for the optimal decoder of a binary symmetric channel (BSC) with flip rate / = P^ ab 
(we assume error bits are uncorrelated) . The residue error, p^ omp ^ after the separation 
scheme, the MUD of Kabashima and the optimal decoder is given by the following 
equation 

1 - H 2 (f) 



1 - H 2 (p 6 Com P) ' 
Typical results are given in the following table. 



(19) 



a 




pCorr 
r b 


pComp 


pCorr /pComp 


0.8 


0.8 


0.034 


0.042 


0.81 


1 


1 


0.067 


0.111 


0.6 



Note that superiority of the proposed scheme relative to the optimal compression alter- 
native is still valid. 



5. Summary 

We have introduced a new scheme for detecting correlated sources directly, with no 
need for source coding, by using a message-passing based multiuser detector. The 
detection was applied simultaneously over a block of transmitted binary symbols. The 
BER improvement for a transmitted block while using the suggested method, have been 
demonstrated. We have exhibited simulation results which demonstrated a substantial 
BER improvement in comparison with the unmodified detector and the alternative of 
source compression. The robustness of our scheme have been shown, under practical 
model settings, including wrong estimation of the generating Markov transition matrix 
at the receiver and when using finite-length spreading codes. 

An important factor in implementing such a scheme is its computational cost. The 
complexity of Kabashima's iterative detector [8], when detecting a bit for a single user is 
0(tN), where t is the number of iterations required for convergence. Adapting it for the 
case of K users, each transmits a word of length L, the complexity is O(LtKN). In the 
proposed scheme, where all the words of all the users are decoded simultaneously, the 
complexity is O(LtKN). Simulations indicate that t and t are comparable, although 
applying the exist algorithm [8] will result in a higher BER. The proposed scheme 
manages to incorporate the knowledge of the correlations between the transmitted 
binary symbols in the existing algorithm [8] without increasing computational cost. 
Though the proposed scheme is heuristic, it still obtains better BER performance relative 
to the unmodified detector and the alternative of source compression. 

Another important factor is the updating scheme of the applied local bias 
calculation on each binary symbol over the transmitted block of information. Four 
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updating schemes were tested on the proposed detector: Parallel updating scheme 
(PUS), sequential updating scheme (SUS), back-front updating scheme (BFUS) and 
random- sequential updating scheme (RSUS). Simulations indicate that the best BER 
performance and convergence rate, in iterations, is achieved while using SUS or BFUS. 
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